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A  COMPARISON  OF  THREE -SUBTEST  AFQT  AND  FOUR-SUBTEST  AFQT 


\  PROBLEM 

-  (The  new  AFQT -9  and  -10,  still  under  development,  and  the  AFQT  score 
obtained  from  the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB)  have 
only  three  subtests:  arithmetic  reasoning,  word  knowledge,  and  pattern 
analysis;  the  tool  knowledge  items  have  been  deleted.  The  three  service 
laboratories  agreed  that  the  tool  knowledge  subtest  did  not  contribute 
enough  to  the  validity  of  the  AFQT  to  warrant  including  it.  (Validity 
data  for  the  AFQT  subtests  are  presented  in  the  Appendix.)  Tool  knowledge 
items  have  been  dropped  from  the  new  Army  Classification  Battery  (ACB) 
and  from  the  new  Navy  Basic  Test  Battery,  which  is  about  to  be  introduced 
for  operational  use. 

The  deletion  of  the  25  item  tool  knowledge  test  has  given  rise  to  a 
concern  of  the  effects  upon  individual  performance,  especially  of  the  low 
scoring  person.  Individuals  with  low  scores  on  AFQT  usually  obtain  higher 
mean  scores  on  the  tool  knowledge  test  than  on  the  other  subtests.  This 
is  reflected  in  the  lower  correlation  between  tool  knowledge  and  the 
remaining  three  subtests  than  between  each  of  the  other  subtests.  Score 
distributions  of  the  three  and  four  subtest  batteries  were  compared  and 
analyzed  in  order  to  determine  the  effects  of  deleting  the  tool  knowledge 
items . 1 

\ 

VARIABLES 

1.  AFQT-7D  and  -8d.  This  version  of  the  AFQT  contains  four  25-item 
subtests:  arithmetic  reasoning,  word  knowledge,  pattern  analysis,  and 
tool  knowledge.  This  version  of  the  AFQT  has  been  in  operational  use 
throughout  the  1960's,  and  was  administered  to  millions  of  men.  Repeated 
samples  have  shown  that  the  distribution  of  scores  remained  similar  to 
the  original  standardization. 

2.  ASVAB  four-subtest  AFQT.  The  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB)  is  an  inter-service  battery  designed  to  measure  the  content 
common  to  the  service  classification  batteries.  The  four  subtests  of  the 
ASVAB  are  parallel  to  the  subtests  of  AFQT-7D  and  -8d.  Each  subtest 
contains  25  items.  The  correlation  between  the  ASVAB  four-subtest  AFQT 
and  AFQT-7D  and  -8d  is  in  the  range  .85-.9O  as  found  in  several  large 
samples . 

3.  ASVAB  three -sub test  AFQT.  A  three-subtest  AFQT,  which  does  not 
contain  tool  knowledge  items,  was  also  obtained  from  ASVAB.  The  ASVAB 
three-subtest  AFQT  has  correlations  in  the  range  .83-. 88,  as  found  in 
several  samples  with  AFQT-7D  and  -8d.  The  ASVAB  four-subtest  and  three- 
subtest  AFQT  scores  correlate  .97*  Beginning  September  1975>  the  ASVAB 
three-subtest  AFQT  is  the  operational  AFQT  score  obtained  from  ASVAB. 


ACB  three-subtest  AFQT.  Beginning  1  July  1973  an  experiment  was 
initiated  in  which  AFQT-7D  and  -8d  were  no  longer  administered  to  Army 
applicants  for  enlistment.  For  the  duration  of  the  experiment,  an  AFQT 
score  is  derived  from  the  three  subtests  of  the  ACB.  These  are  arithmetic 
reasoning,  word  knowledge,  and  pattern  analysis.  Each  of  these  subtests 
has  20  items  for  a  total  of  CO  items  in  the  ACB  AFQT.  The  correlation 
of  ACB  AFQT  and  AFQT-7D  and  -8d  is  .84  in  a  large  sample  of  3,760  men. 

No  correlation  with  ASVAB  AFQT  scores  is  available. 


PROCEDURE 

A  large  representative  sample  of  about  25OO  men  at  Armed  Forces  Exam¬ 
ining  and  Entrance  Stations  (AFEES)  was  obtained  in  1972  to  standardize 
new  forms  of  the  ASVAB.  AFQT-7D  and  -8d  scores  were  also  obtained  for 
this  sample.  The  correlations  between  ASVAB  AFQT  and  AFQT-7D  and  -8d 
reported  above  were  obtained  on  subgroups  of  this  sample.  Both  four- 
subtest  and  three-subtest  ASVAB  AFQT  scores  were  obtained  for  each  man 
in  the  sample.  The  three-subtest  AFQT  is  being  used  operationally  in 
ASVAB  beginning  September  1973*  Three  joint  distributions  of  AFQT  scores 
were  obtained  for  the  AFQT  scores;  these  are:  AFQT-7D  and  -8d  vs.  ASVAB 
four-subtest  AFQT;  AFQT-7D  and  -8d  vs.  ASVAB  three-subtest  AFQT;  and 
ASVAB  four-subtest  AFQT  vs.  ASVAB  three-subtest  AFQT. 

A  smaller  experiment  was  conducted  on  about  500  Army  accessions  at 
Ft.  Jackson,  SC  to  obtain  an  estimate  of  the  relationship  between  the  ACB 
AFQT  and  AFQT-7D  and  -8d.  Since  this  sample  is  restricted  to  Army  acces¬ 
sions  the  results  are  not  representative  of  men  in  the  extreme  low  range. 

Men  who  had  previously  failed  the  ACB  AFQT  at  AFEES  were  excluded.  Also 
people  who  had  failed  to  qualify  on  the  aptitude  area  standards  (I-90  for 
high  school  graduates  and  2*90' s  for  non-graduates)  were  also  excluded. 

The  AFQT-7D  and  -8D  was  administered  and  the  three  ACB  subtests  that  compose 
the  AFQT  (arithmetic  reasoning,  word  knowledge,  and  pattern  analysis) 
were  readministered  at  the  Ft.  Jackson  reception  station.  A  different  form 
of  the  ACB  AFQT  was  administered  at  the  reception  station  as  compared  to 
the  AFEES. 

The  AFQT  scores  were  grouped  into  administratively  convenient  categories 
for  presentation.  The  scores  are  reported  on  the  percentile  scale.  The 
percentile  score  categories  are  as  follows: 


AFQT  Percentile  Score 

Mental  Category 

0-9 

V 

10-19 

lower  IV 

20-50 

Upper  IV 

31-49 

lower  III 

50-69 

upper  III  and  bottom  of  II 

70-100 

II  and  I 

RESULTS 


The  joint  distributions  are  presented  in  Tables  1  — .  In  each  table, 
frequency  counts  are  shown  in  Part  A  and  percentages  are  presented  in  Part  B. 
The  frequencies  show  the  number  of  men  in  each  AFQT  score  category  and  the 
distribution  within  each  score  category.  For  example  in  Table  1,  which 
shows  the  relationship  between  AFQT-7D  and  -8d  and  the  ASVAB  four-subtest 
AFQT,  there  were  12Q  men  who  scored  0~9  on  AFQT-'/T)  and  -Sr>.  Of 
these  129,  88  also  scored  0- >  on  the  ASVAB  four-subtest  AFQT,  and  Jf  scored 
10-19  on  the  ASVAB  AFQT.  Five  scored  20-30  on  the  ASVAB  four-subtest  AFQT 
and  none  scored  higher.  The  total  number  of  men  in  the  sample  was  2494. 

In  Part  B  of  each  table  the  number  of  men  in  each  column  is  converted 
to  percentages.  The  numbers  show  the  percentage  of  men  in  each  column  who 
scored  in  the  various  score  categories  on  the  other  test.  The  sum  of  the 
percentages  in  each  column  is  100,  within  rounding  error.  The  numbers 
shown  in  the  Total  row  show  the  percentage  of  the  total  sample  that  scored 
in  each  category.  For  example  in  Table  1,  19  percent  of  the  sample  ( 4' 2 
of  2494)  scored  in  the  AFQT-'/T)  and  -8D  score  category  31-49.  Of  the  482 
men  in  this  category,  20  percent  scored  in  the  next  lower  categorv  (20-10) 
on  the  ASVAB  four-subtest  AFQT,  4°  percent  scored  in  the  same  category,  and 
24  percent  were  in  the  next  higher  category  ( 50-69) •  The  percentage  of  men 
in  each  row  is  shown  in  the  final  column  of  Part  B  of  each  table.  Tn  Tables 
1,  2,  and  4  the  percentages  in  each  column  are  based  on  the  number  of  men  in 
each  AFQT-TD  and  -8d  score  category.  In  Table  3  the  column  percentages  are 
based  on  the  number  in  each  ASVAB  four-subtest  category. 

The  pattern  of  results  is  similar  in  each  table.  The  men  tended  to 
obtain  similar  scores  on  the  two  versions  of  the  AFQT.  Some  of  the  men 
scored  higher  on  one  test  and  others  scored  lower,  and  many  scored  in  the 
same  category.  There  were  no  systematic  differences  on  the  three-part  vs. 
four-part  comparisons.  In  general,  men  who  scored  low  on  the  four-subtest 
AFQT  did  better  on  the  one  with  three-subtests,  and  conversely,  men  who 
scored  low  on  the  three-subtest  AFQT  tended  to  score  higher  on  the  four- 
subtest  AFQT.  The  distributions  can  be  readily  explained  by  the  regression 
effect,  which  operates  in  any  pair  of  variables  that  are  not  perfectly 
correlated. 

The  extent  of  the  shift  in  scores  from  the  four-subtest  AFQT  to  the 
three-subtest  version  is  exaggerated  by  the  mode  of  display.  In  Table  3 
the  four-and  three-subtest  ASVAB  AFQT's  are  compared.  The  correlation 
between  these  two  is  .97,  which  is  close  to  perfect,  and  yet  there  are 
sizable  percentages  in  different  categories.  Of  the  301  men  who  scored 
20-30  on  the  four-subtest  ASVAB  AFQT,  55  percent  scored  in  the  same  category 
on  the  three-subtest  form,  but  20  percent  scored  in  the  lower  adjacent 
category  and  24  percent  scored  in  the  higher  adjacent  one.  The  remaining 
one  percent  was  further  removed  on  the  three-test  AFQT.  The  seemingly 
large  shift  in  scores  arises  primarily  because  of  small  score  changes  at 
the  boundaries  of  the  categories.  In  the  other  tables  where  the  correlation 
is  lower,  the  score  changes  are  larger.  The  greater  change  is  reflected  in 
the  greater  dispersion  of  scores  in  each  column  in  Tables  1,2,  and  4 
as  compared  to  Table  3» 


The  results  in  Table  4  compare  the  ACB  AFQT,  used  in  the  experimental 
standards  effective  1  July  1075,  and  AFQT-7D  and  -cSD,  used  operationally 
until  1  July  1Q75*  The  results  are  consistent  with  those  obtained  on  the 
larger  and  more  representative  ASVAB  samples.  At  the  lower  AFQT-7D  and 
-D  categories,  more  men  had  higher  scores  on  the  ACB  AFQT.  Conversely, 
at  the  upper  end,  more  men  had  lower  scores  on  the  ACB  AFQT.  Again  the 
results  reflect  primarily  the  regression  effect. 

There  is  no  evidence  that  the  standardization  of  the  ACB  AFQT  is 
not  satisfactory.  Generally  there  are  no  gross  discrepancies  between 
ACB  AFQT  and  AFQT-7D  and  -c D  in  the  percentage  of  cases  in  each  score 
category.  Data  collected  on  the  July  1975  applicants  confirm  the  appro¬ 
priateness  of  the  conversion  tables  for  ACB  AFQT. 


CONCLUSIONS 

It  is  clear  from  the  results  that  the  three-subtest  AFQI  has  a  score 
distribution  similar  to  that  of  the  four-subtest  AFQT.  Individuals  with 
low  scores  on  the  four-subtest  AFQT  sometimes  had  higher  scores,  sometimes 
had  lower  scores,  and  usually  had  similar  scores  on  the  three-subtest  AFQT. 
The  same  pattern  held  for  men  with  high  scores.  No  part  of  the  distribution 
was  systematically  different  on  the  two  kinds  of  AFQT. 


Table  1 


COMPARISON  OF  AFQT-7D  AND  -8d  WITH  ASVAB  FOUR -SUBTEST  AFQT 


Part  A.  Frequency  Count  in  each  Score  Category 
ASVAB  Four- 

Subtest  AFQT  AFQT “7®  and  -8D 


Percentile  Score 
rateeorv  0-9 

Percentile  Score  Category 

10-1Q  20-%  31-49  50-69 

70-100 

Total 

0-  9 

88 

55 

11 

10 

02 

01 

167 

10-  19 

36 

85 

37 

16 

06 

00 

l80 

20- 

05 

86 

94 

95 

18 

03 

301 

31-  49 

00 

32 

80 

236 

148 

22 

518 

50-  09 

00 

02 

13 

114 

289 

181 

599 

yn  - 1 no 

00 

04 

02 

11 

110 

602 

729 

Total 

129 

264 

237 

482 

573 

809 

2404 

Part  B.  Percentage 

ASVAB  Four- 
Subtest  AFQT 
Percentile  Score 

in  each 

0-9 

Score  Category 

AFQT -7D  and  -8D 

Percentile  Score  Category 

10-1Q  20-30  31-49  50-69 

70-100 

<f>  of 
Total 

0-  9 

68 

21 

05 

02 

01 

00 

07 

10-  19 

28 

32 

16 

03 

01 

00 

07 

20-  30 

04 

33 

40 

20 

03 

01 

12 

31-  49 

00 

12 

34 

49 

26 

03 

21 

50-  6£ 

00 

01 

05 

24 

50 

22 

24 

70-100 

00 

01 

00 

02 

19 

74 

29 

&  of  Total 

05 

11 

10 

19 

23 

32 

100 

COMPARISON  OF  AFQT-/1)  AND  -  D  WITH  AS  VAT  THREE 


Part  A.  Frequency  Count  in  each  Score  Category 
ASVAB  Three - 

Subtest  AFQT  AFQT -YD  and  D 

Percentile  Score  Percentile  Score  Cate  cor 

Category _ 10-10  20-%  M-40 


Part  B.  Percentage 

in  each  Score  Category 

ASVAB  Three- 

Subtest  AFQT 

AFQT  -  fD  and  -YD 

Percentile  Score 

Percentile  Score  Categor 

Category 

0-0  10-10  20-%  ^1-40 

Table  3 

COMPARISON  OF  ASVAB  FOUR-SUBTEST  AFQT  WITH  ASVAB  THREE -SUBTEST  AFQT 


Part  A.  Frequency  Count  in  each  Score  Category 
ASVAB  Three  - 

Subtest  AFQT  ASVAB  Four-Subtest  AFQT 


Percentile  Score 

Cafesorv  0-9 

Percentile  Score  Category 

TO -IQ  20-90  31-49  90-69 

70-100 

Total 

0-  9 

138 

15 

00 

00 

00 

00 

153 

10-  19 

29 

135 

61 

01 

00 

00 

226 

20-  30 

00 

28 

165 

81 

00 

00 

274 

31-  49 

00 

02 

73 

320 

89 

00 

484 

90-  69 

00 

00 

02 

113 

393 

106 

614 

7D-]00 

00 

00 

00 

02_ 

113 _ 

629 

741 

Total 

167 

180 

301 

518 

595 

731 

2494 

Part  B.  Percentage  in  each  Score  Category 


ASVAB  Three - 
Subtest  AFQT 

Percentile  Score 
(’atsonrv  0-9 

ASVAB  Four-Subtest  AFQT 
Percentile  Score  Category 

10-1Q  20-30  31-49  90-69 

70-100 

of 

Total 

a  -  u - - — ■ 

0-  9 

83 

08 

00 

00 

00 

00 

06 

10-  19 

17 

75 

20 

00 

00 

00 

09 

20-  30 

00 

16 

55 

16 

00 

00 

11 

31-  49 

00 

01 

24 

62 

15 

00 

20 

90-  69 

00 

01 

22 

66 

15 

24 

70-100 

00 

00 

00 

,19- 

_ 85 _ 

30 

1  low 

$  of  Total 

07 

07 

12 

21 

24 

29 

100 

l.ible  -1 


APPENDIX 


VALIDITY  COEFFICIENTS  OF  THE  PARTS  OF  AFQT 


MOS  Croup® 


AFQT  Part 

CO 

FA 

EL 

OF 

SC 

MM 

GM 

CL 

ST 

Mean 

Arith.  Reas. 

.44 

•  . 

p:  »< 

•  33 

.00 

•55 

•55 

.02 

.(2 

•  5 4 

Word  Knowl. 

.  ')Q 

.  4 

.14 

.30 

•  50 

•  53 

•51 

•  03 

.60 

•  51 

Spatial  Rel. 

.  67 

.40 

•  25 

•  51 

•  50 

.3$ 

•  37 

.49 

.42 

Tool  Knowl. 

.30 

.30 

.42 

.20 

•  52 

•  53 

•  43 

.24 

.20 

•  35 

Validity  of  three-part 

AFQT 

(AR,  WK,  and 

Spatial)  = 

• 

Validity  of 

four- 

part  AFQT  (AR,  WK, 

Spatial,  and  TK) 

=  ..'0 

CO  -  Combat;  FA  -  Field  Artillery;  EL  -  Electronics  Repair;  OF  -  Operators 
and  Food;  SC  -  Survei 1 lance/Communicat ions ;  MM  ■  Mechanical  Maintenance; 

CM  ■  General  Maintenance;  CL  *  Clerical;  ST  -  Skilled  Technical 


Source : 


Maier,  M.  H.,  and  Fuchs,  E.  F.  Development  and  Evaluation  of  a 
New  ACB  and  Aptitude  Area  System.  ARI  Technical  Research  Note  ?r"‘* 
September  1 072 . 


